Efficient common storage of partially encrypted content

ABSTRACT

Techniques and mechanisms described herein facilitate the efficient common storage of partially encrypted content. According to various embodiments, a client device to transmit a designated representation of a media content item via a communications interface may be received. The media content item may be associated with a plurality of representations including the designated representation. The media content item may be associated with first media content data and second media content data. The first media content data may be shared among the plurality of representations. The second media content data may be specific to the designated representation. The first media content data may be combined with the second media content data to create a designated partially encrypted media content portion associated with the designated representation via a processor. The designated partially encrypted media content portion may be transmitted to the client device via the communications interface.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of and claims priority to U.S. patentapplication Ser. No. 13/953,482 (Attorney Docket No. MOBIP123)“EFFICIENT COMMON STORAGE OF PARTIALLY ENCRYPTED CONTENT,” by TorbjornEinarsson, filed Jul. 29, 2013, which is incorporated by referenceherein in its entirety and for all purposes.

TECHNICAL FIELD

The present disclosure relates to the storage and delivery ofdownloadable media content.

DESCRIPTION OF RELATED ART

In some media systems, a user may download and store a media contentitem such as a video to view immediately or at a later time. The mediacontent may include one or more files that are stored on the user'scomputing device. The computing device may be a mobile phone, a desktopcomputer, a laptop, a tablet computer, a smart television, a digitalvideo recorder, or any other type of computing device.

Media content such as video and audio may be streamed over a network(e.g., via HTTP) in any of various formats. In order to support mediacontent transmission to different types of devices, media systems may beconfigured to deliver media content in a variety of formats.

One way to accomplish the goal of providing media content in differentformats is to reformat the content upon each request. However, if themedia content is encrypted, substantial computing resources may beneeded to perform the decryption and/or encryption necessary totransform the media content into the appropriate format.

Another way to accomplish the goal of providing media content indifferent formats is to perform any necessary decryption and encryptionin advance and store the media content in more than one format. However,this approach may involve storing potentially many different copies ofmedia content, which may require substantial digital storage space in adigital storage system.

Many types of encryption formats do not support the transformation fromone type of content representation to a different contentrepresentation. For instance, the MPEG-2 transport stream (TS)-basedformats are used by Apple's HTTP Live Streaming (HLS) representation.One HLS format (SAMPLE-AES) is based on encrypting samples partiallyusing AES-128 in CBC mode. In contrast, the Common Encryption Format(CEF) uses AES-128 in CTR mode as default. Transforming from CTR to CBCmode involves decrypting and re-encrypting the content. Thus, underconventional systems, supporting the delivery of content encrypted ineither CBC mode or CTR mode involves storing different copies of mediacontent data or performing complex decryption and/or encryptionprocedures when content is requested.

BRIEF DESCRIPTION OF THE DRAWINGS

The disclosure may best be understood by reference to the followingdescription taken in conjunction with the accompanying drawings, whichillustrate particular embodiments.

FIG. 1 illustrates an example of a system for providing media contentdata, configured in accordance with one or more embodiments.

FIG. 2 illustrates an example of an arrangement of media content data.

FIG. 3 illustrates a method for creating media content representationdata, performed in accordance with one or more embodiments.

FIG. 4 illustrates a method for delivering media content to a clientmachine.

FIG. 5 illustrates one example of an exchange used with a media deliverysystem.

FIG. 6 illustrates one technique for generating a media segment.

FIG. 7 illustrates an example of a system.

DESCRIPTION OF EXAMPLE EMBODIMENTS

Reference will now be made in detail to some specific examples of theinvention including the best modes contemplated by the inventors forcarrying out the invention. Examples of these specific embodiments areillustrated in the accompanying drawings. While the invention isdescribed in conjunction with these specific embodiments, it will beunderstood that it is not intended to limit the invention to thedescribed embodiments. On the contrary, it is intended to coveralternatives, modifications, and equivalents as may be included withinthe spirit and scope of the invention as defined by the appended claims.

For example, the techniques of the present invention will be describedin the context of fragments, particular servers and encoding mechanisms.However, it should be noted that the techniques of the present inventionapply to a wide variety of different fragments, segments, servers andencoding mechanisms. In the following description, numerous specificdetails are set forth in order to provide a thorough understanding ofthe present invention. Particular example embodiments of the presentinvention may be implemented without some or all of these specificdetails. In other instances, well known process operations have not beendescribed in detail in order not to unnecessarily obscure the presentinvention.

Various techniques and mechanisms of the present invention willsometimes be described in singular form for clarity. However, it shouldbe noted that some embodiments include multiple iterations of atechnique or multiple instantiations of a mechanism unless notedotherwise. For example, a system uses a processor in a variety ofcontexts. However, it will be appreciated that a system can use multipleprocessors while remaining within the scope of the present inventionunless otherwise noted. Furthermore, the techniques and mechanisms ofthe present invention will sometimes describe a connection between twoentities. It should be noted that a connection between two entities doesnot necessarily mean a direct, unimpeded connection, as a variety ofother entities may reside between the two entities. For example, aprocessor may be connected to memory, but it will be appreciated that avariety of bridges and controllers may reside between the processor andmemory. Consequently, a connection does not necessarily mean a direct,unimpeded connection unless otherwise noted.

Overview

According to various embodiments, techniques and mechanisms describedherein may facilitate the efficient common storage of partiallyencrypted media content in different media content representations.Media content items such as video and/or audio files may be encrypted toprovide digital rights management (DRM) protection. For many mediacontent items, encrypting a subset of the media content data issufficient to DRM protection. Many representations, such as HLS withsample encryption and CEF, may support encrypting only a subset of themedia content data rather than all of the data. In order to providemedia content in different formats such as HLS and CEF, a portion of thecontent may be encrypted in advance in each of the different formats,while the rest of the content may be left unencrypted. For instance, forencrypted media, HLS stores the content as MPEG-TS files with eitherfull or partial samples encrypted with AES. DASH stores files in an ISOfile format according to the CEF encryption standard. Then, when arequest for a media content item in a particular format is received, theunencrypted content portions may be combined with the encrypted contentportions that are encrypted via the format-specific encryption to createthe media content item representation for the requested format. In thisway, media content may be provided in different formats withoutperforming computationally intensive decryption and/or encryptionoperations in response to each content request and without storing morethan one complete copy of the media content.

EXAMPLE EMBODIMENTS

According to various embodiments, users may receive content from acontent management service. The content management service mayfacilitate the interaction of users with various types of contentservices. For instance, the content management service may be used toprovide content upon request to any number of content playback devices.In order to protect the content from unauthorized usage via DRM, atleast a portion of content transmitted to client devices must beencrypted.

According to various embodiments, content may be provided in differenttypes of content representations such as SAMPLE-AES and CEF in order tosupport the transmission of content to client devices that differ interms of the hardware, software, and/or data transmission capabilities.

According to various embodiments, a single copy of each of some portionsof a media content item may be stored in the media system in anunencrypted state. These unencrypted portions may be used in conjunctionwith different types of content representations.

According to various embodiments, more than one copy of other portionsof the same media content item may be stored in the media system in anencrypted state. Each copy may be encrypted in a format that is specificto one or more media content representations. For instance, a portion ofa media content item may be encrypted in one format for SAMPLE-AES and adifferent format for CEF. Then, different copies of the portion of themedia content item that are encrypted in each of these different formatsmay be stored. When media content is requested in a particularrepresentation, the unencrypted portions of the media content may becombined with the appropriate encrypted portions to construct therequested representation of the media content.

In particular embodiments, the portions of the media content that areencrypted may correspond to a relatively limited percentage ofparticular sections of the media content. For example, a media systemmay store video content in CEF format with 10% of key frame bytesencrypted. The rest of the key frame bytes as well as the non-key framebytes may be left unencrypted. The encrypted key frame byte ranges maybe encrypted separately in AES-128 CTR mode as well as in AES-128 CBCmode. Then, the media system may construct HLS video in SampleEncryption mode (SAMPLE-AES) by repackaging the unencrypted videocontent with the additionally stored CBC-encrypted content. The mediasystem may provide CEF video in a similar fashion.

In particular embodiments, content such as video may be delivered indifferent formats such as CEF and SAMPLE-AES mode with simplerepackaging and no need to decrypt content. At the same time, thestorage overhead to the size of the encrypted parts of the video may bereduced relative to conventional systems in which a copy of all of thevideo content is stored for each supported format. For instance, inparticular embodiments the portion of the media content that isencrypted may be approximately 10% of the key frames of a video file,which may correspond to an increase in storage overhead of only 2-3% ofthe total video bitrate.

Although media content may be referred to herein as video content, thetechniques and mechanisms described herein are generally applicable to awide range of content and content distribution frameworks. For example,the content may be any media content such as video content, audiocontent, and/or image content.

The storage capacity, write speed, read speed, and other characteristicsdescribed herein are included for the purpose of clarity and to provideexamples. Computer hardware, software, and networking characteristicschange over time. Nevertheless, the techniques described herein arewidely applicable to storage systems and frameworks having varioushardware, software, and networking characteristics.

FIG. 1 illustrates an example of a system 100 for providing mediacontent data, configured in accordance with one or more embodiments.According to various embodiments, the media system 100 may be used topre-process video data for storage in a storage system and then use thepre-processed data to provide different representations of a mediacontent item upon request. The media system 100 may provide variousmedia-related services to different client machines and may allow clientmachines to access various types of media content such as on-demandvideo.

At 102, an encoder is shown. According to various embodiments, theencoder may receive content in one or more standard formats and thenencode it for presentation at a client machine. For instance, theencoder may receive a raw video file composed of raw video data, or avideo file in a format other than that intended for transmission toclient machines. Then, then encoder may perform one or more operationsfor transcoding the media content.

According to various embodiments, encoding content data may facilitatethe transmission of content data to different types of client machines.For example, raw video data files may be too large to practically sendover a network to client machines. In this case, the video data may betranscoded to a lower bitrate for easier transmission to clientmachines. As another example, different client machines may havedifferent media capabilities, and the video data received by the encodermay be transcoded to facilitate presentation at these differentmachines.

At 104, a packager is shown. According to various embodiments, thepackager may perform operations such as packaging an encoded video for aparticular media representation. For instance, the packager may divide avideo file into transport segments in accordance with an HLSrepresentation or file fragments in accordance with an FMP4 or DASHrepresentation.

According to various embodiments, the packager may partially encrypt themedia content data, which may help to protect the media content dataagainst unauthorized access. For instance, the packager may identifysamples of the media content data to partially encrypt, identify slicesof the identified samples to encrypt, and encrypt the identified slices.Examples of the types of operations that may be performed by theprocessor are discussed in further detail with respect to FIG. 3.

At 106, a storage system is shown. According to various embodiments, thestorage system may store the common data as well as therepresentation-specific data generated by the package 104. For instance,the storage system 106 may store unencrypted header data and unencryptedmedia content data. The storage system may also store the unencryptedand encrypted portions of partially encrypted media content samples. Theinformation stored in the storage system 106 may be retrieved by thecontent server 108 upon request in order to provide the media contentrepresentations.

At 108, a content server is shown. According to various embodiments, thecontent server may be configured to provide content upon request toclient machines in communication with the media system. The contentserver may perform operations such as receiving a request for a mediacontent item, constructing the appropriate representation of the mediacontent item, and transmitting the constructed representation to theclient machine. Examples of operations that may be performed by thecontent server are discussed in further detail with respect to FIG. 4.

According to various embodiments, at least some of the contenttransmitted to client machines may be cached. For instance, if arepresentation of a media content item is requested by one clientmachine and is shortly thereafter requested by other client machines,the representation may be constructed once for the first client machineand then stored in cache memory. Then, when subsequent requests arereceived, the requesting client machines may be sent the cached versionwithout separately constructing the media content representation inresponse to each request.

Client machines are shown at 110, at 112, and at 114. According tovarious embodiments, a media system may be in communication with anynumber of client machines. Client machines may communicate with themedia system in order to request and receive content for presentation atthe client machines or at other devices in communication with the clientmachines.

According to various embodiments, a media system may potentiallycommunicate with any of a variety of client machines. For instance, aclient machine may be a desktop computer, a laptop computer, a tabletcomputer, a mobile phone, a conventional or smart television, a cablebox, or any other type of device capable of receiving content. It shouldbe noted that the client machines may differ in aspects such as theirsoftware configuration, hardware configuration, bandwidth, latency, andother characteristics. Accordingly different client machines may need tobe sent different representations of the same content item in order topresent it.

FIG. 2 illustrates an example of an arrangement of media content data.FIG. 2 includes a section 202 of a first media content representationand a section 214 of a second media content representation. FIG. 2 alsoincludes a section 220 of media content representation data.

According to various embodiments, media content may be represented indifferent ways. For instance, a video file may be provided in both CEFand SAMPLE-AES representations. More than one representation of a mediacontent item may be provided to support the transmission of mediacontent to client devices that differ in terms of hardware and/orsoftware characteristics. For example, client devices may differ interms of software such as operating systems and media players. Asanother example, client devices may include different types of hardwarecomponents. As yet another example, client devices may include desktopcomputers, televisions, mobile phones, tablet computers, laptopcomputers, smart televisions, cable boxes, or any other configuration ofcomputing hardware.

According to various embodiments, different representations of a mediacontent item may differ in terms of the division of media contentsamples into sections. Depending on the particular media contentrepresentation employed, a section of media content may be referred toin different ways. For instance, in different representations, a mediacontent section may be referred to as a segment or a fragment. Eachsegment or fragment may include some number of media content samples.For instance, a media content section may include one, two, four, orpotentially many different media content samples.

The media content section 214 includes two different sets of headers andvideo content data, each set of which may be referred to as its ownsection, segment, or fragment. However, the amount of video contentincluded in the two sections of media content representations 202 and214 is kept the same for the purpose of clarity.

In particular embodiments, each video content sample may correspond witha video frame. A frame may be a key frame or a non-key frame (alsoreferred to herein as an intermediate frame). Key frames may be used toconstruct and/or fill in data for intermediate frames. However, themedia content data to which the techniques and mechanisms describedherein are applied need not be video content data. For instance, thetechniques and mechanisms are generally applicable to other types ofmedia content data such as audio data.

According to various embodiments, different representations of a mediacontent item may include media content data that is common to thedifferent representations. For instance, a video file may be provided inboth CEF and HLS SAMPLE-AES representations. However, these differentrepresentations may include the same video content data. For instance,the sections 202 and 214 of different media content representationsshown in FIG. 2 each include the common video content samples 208, 210,and 212.

According to various embodiments, different representations of a mediacontent item may differ in terms of header content associated with eachsection. The header portion of a section may provide information for amedia player to use in accessing the content stored within the section.For instance, the media content section 202 includes the header portionH1 a 204 that includes information for accessing the video samples 206,208, 210, and 212 associated with the header portion H1 a 204. The mediacontent section 214 includes the header portion H1 b 216 that includesinformation for accessing the video samples 218 and 208 associated withthe header portion H1 b 216. The media content section 214 also includesthe header portion H1 b 218 that includes information for accessing thevideo samples 210 and 212 associated with the header portion H1 b 216.

According to various embodiments, different representations of mediacontent may involve different types of encryption techniques. Forexample, one type of video content representation may involve the use ofAES-128 CTR mode encryption, while a different type of video contentrepresentation may involve the use of AES-128 CBC mode encryption. If amedia system is to support both types of video content representations,then the same media content encrypted via both types of encryptiontechniques needs to be made available upon request.

In particular embodiments, a media content item may be protected withDRM-style content protection without encrypting the entire media contentitem. As long as a sufficient portion of the media content item isencrypted, the media content data may be rendered unusable without theappropriate permissions.

For example, rather than encrypting each frame of a video file, onlycertain frames may be encrypted. The encrypted frames may includeparticularly important frames such as key frames. Alternately, oradditionally, the encrypted frames may include frames chosen accordingto different criteria, such as frames chosen at random or framesselected at designated intervals.

As another example, rather than encrypting an entire media sample suchas a video frame, only a portion of the sample may be encrypted. Forinstance, a frame may be divided into slices, and only one or more ofthe slices may be encrypted. In particular embodiments, slices may be ofdifferent sizes. For instance, the first 64 bytes of substantive contentin a video frame may be encrypted. Then, the next 512 bytes may be leftunencrypted, and the following 64 bytes may be encrypted, with thepattern continuing as necessary.

According to various embodiments, the particular partial encryptionscheme used may be strategically determined based on any of variousfactors, such as the characteristics of the media being encrypted, thecomputing cost associated with encryption and decryption, and thecharacteristics of the encryption technique being employed.

In particular embodiments related to video content, each key frame maybe partially encrypted. Within each key frame, the first portion ofsubstantive data may be encrypted. In many encoding schemes, the firstportion of substantive data within a key frame defines the structure ofthe frame. Thus, without this important data, the key frame cannot bereconstructed. Similarly, without constructing the key frame, theintermediate frames between key frames cannot be reconstructed. Thus, bypartially encrypting an important slice of an important frame, an entiresection of media content data may be encrypted. However, differentencryption schemes may be applied to different types of media contentrepresentations.

According to various embodiments, the section of media contentrepresentation data 220 shown in FIG. 2 may be used to provide the twodifferent media content representations 202 and 214. The media contentrepresentation data 220 includes the header data portion 222 and themedia content data samples 224, 208, 210, and 212.

According to various embodiments, the header data portion 222 may beused to construct the header portions 204 and 216 for the differentmedia content representations. In particular embodiments, the headerdata portion 222 may corresponding exactly or almost exactly to one ofthe header portions 204 and 216. Then, the header data portion 222 maybe quickly transformed upon request to the other header portion.Alternately, the header data portion 222 may serve as input data used toconstruct both of the header portions 204 and 216 upon request.

According to various embodiments, the media content samples 208, 210,and 212 may include media content data used to present the section ofmedia content. For instance, each media content sample may correspond toa video frame or an audio sample. As shown in FIG. 2, at least some ofthe media content samples may be the same across different media contentitem representations. When a representation is selected, the appropriatecommon media content samples may be selected to provide the requestedrepresentation.

The media content data sample 224 is partially encrypted. The mediacontent data sample 224 is divided into different components V1A 226,V1B, V1C 232, and V1D 234. For instance, a video sample such as a framemay be divided into different slices. Each slice may correspond with asubset of the data that makes up the media content data sample.

According to various embodiments, one or more components of a partiallyencrypted data sample may be stored in an unencrypted state. Forinstance, the data sample components V1A 226, V1C 232, and V1D 234 arestored in an unencrypted state. These data sample components are commonto the different media content representations.

According to various embodiments, one or more components of a partiallyencrypted data sample may be stored in an encrypted state. For instance,the data sample component V1B is stored separately in the encryptedstate V1B1 228 and the encrypted state V1B2 230. These differentencrypted states each correspond with one of the media contentrepresentations.

According to various embodiments, when a media content itemrepresentation is requested, unencrypted data may be combined withrepresentation-specific encrypted data to provide a partially encrypteddata sample. This partially encrypted data sample may be combined withheaders and unencrypted data to construct a representations-specificmedia content section. Potentially many different media content sectionsmay be constructed in this way to provide a completed media content itemrepresentation. Techniques for providing media content representationsin this way are discussed in further detail with respect to FIGS. 3 and4.

Although FIG. 2 shows only a limited section of each media contentrepresentation, many media content items includes many differentsections of media content. For instance, a video file for a movie mayinclude many thousands of key frames.

Further, although FIG. 2 shows an arrangement of media content data thatmay be used in conjunction with two different media contentrepresentations, a media system may support potentially many differentmedia content representations. When more media content representationsare supported, media slide data portions may be stored for the mediasample slice V1B in addition to the media sample slice data portions 228and 230.

In this way, different representations of the same media content itemmay be provided upon request. In particular embodiments, differentrepresentations of the media content item may be provided withoutperforming encryption or decryption of the media content. At the sametime, the different representations may be provided without storing morethan one copy of all of the media content data associated with the mediacontent item. Thus, techniques and mechanisms described herein may helprelieve the tension between processor usage and storage usage whenproviding different representations of the same media content item.

FIG. 3 illustrates a method 300 for creating media contentrepresentation data, performed in accordance with one or moreembodiments. According to various embodiments, the method 300 may beused to create, organize, and store the information needed to providedifferent representations of a media content item upon request. Forinstance, the method 300 may be used to create the section 220 of mediacontent representation data shown in FIG. 2.

At 302, a request to create data for providing representations of amedia content item is received. According to various embodiments, therequest may be received when an item of media content is received by themedia system for the purpose of providing to client devices requestingthe media content. Alternately, or additionally, the request may bereceived when media content is designated for re-encoding, for instanceat a different bitrate or file size.

At 304, media content item data for creating the one or morerepresentations of the media content is identified. According to variousembodiments, the media content item data may be any information used toconstruct a representation of the media content item. For example, themedia content item data may include media content data such as video oraudio samples. This media content data may be used by a media player topresent the media for playback. As another example, the media contentitem data may include header data. The header data may act as a type ofmetadata that provides instructions to the media player regarding how tointerpret the media content data.

At 306, a first portion of the media content item data is identified forstoring in an unencrypted state. According to various embodiments, onlya portion of a media content item need be encrypted in order to protectthe media content item with DRM-style content protection. Then, theremainder of the content data that is stored in an unencrypted state maybe shared across different media content representations.

The data selected for storing in an unencrypted state may include anyinformation that is not selected for complete or partial encryption. Inparticular embodiments, relatively less important data may be selectedfor storing in an unencrypted state. For example, in video content,non-key frames may be stored in an unencrypted state. As anotherexample, data to be stored in an unencrypted state may be selected basedon data compression techniques employed. For instance, when usingLempel-Ziv-Welch (LZW) data compression, a dictionary table may be usedto describe compressed data. In such schemes, the dictionary table maybe encrypted while the compressed data itself may be stored in anunencrypted state.

At 308, a second portion of the media content item data is identifiedfor storing in a partially encrypted state. According to variousembodiments, the second portion of the media content item data may beidentified by selecting any portions of the media content data that, ifencrypted would help to prevent reconstruction of the unencrypted mediacontent item. For example, portions of media content item data toencrypt may be selected at random or at regular intervals. As anotherexample, relatively important portions of media content items such askey frames in video content data may be selected.

At 310, a sample of the section portion of the data is selected forpartial encryption. According to various embodiments, each sampleincluded in the second portion of the data identified at operation 308may be separately and partially encrypted via different encryptiontechniques. For instance, the samples may be selected sequentially or inany other ordering.

At 312, one or more subsets of the selected sample are selected forencryption. According to various embodiments, a sample may be a portionof data such as a video frame. The sample may be divided into differentsubsets. For instance, video frame data may be divided into slices.Then, some of the subsets may be encrypted while others are not. In thisway, the video content may be protected while encrypting only a subsetof each of selected samples of the video content.

According to various embodiments, the selection of sample subsets forencryption may be strategically performed based on the type of dataincluded in the sample. For instance, in some video frames, the firstslice of data includes configuration data, the second slice of dataincludes structural and relational data, and the remaining slices ofdata include content data with which the configuration data andstructural data may be combined to generate the complete frame. In thisarrangement, encryption of only the second slice of data may provide arelatively high level of content protection at a relatively low cost ofencryption. However, in different arrangements of data, differentarrangements of slices and different selections of one or more subsetsfor encryption may be used.

At 314, the one or more subsets are encrypted using a first encryptiontechnique. At 316, the one or more subsets are encrypted using a secondencryption technique. According to various embodiments, the differentencryption techniques may correspond to different media contentrepresentations. For instance, one encryption technique may be AES-128in CTR mode, while the other encryption technique may be AES-128 in CBCmode. However, a variety of encryption techniques may be used.

In particular embodiments, the particular encryption techniques used maybe strategically determined based on the types of media contentrepresentations offered by the media system. Further, more than twodifferent encryption techniques may be applied. For instance, a mediasystem may offer a media content item according to one, two, or anynumber of different representations.

At 318, a determination is made as to whether to partially encrypt anadditional sample of the media content item data. As discussed withrespect to operations 306-310, only some samples of a media content itemneed be selected for encryption in order to protect the content. Thedetermination made at operation 316 may involve determining whether eachsample identified for partial encryption has been partially encrypted atoperation 310.

At 320, header data for the media content item is identified. Accordingto various embodiments, the header data may be used for providing headerdata portions for media segments in the media content representations.An example of header data is discussed with respect to the header data222 shown in FIG. 2.

According to various embodiments, the header data may be configured inany of various ways. For example, the header data for a particular mediacontent section may correspond to the header portion of a section for aparticular media content representation. When a different media contentrepresentation is selected, the header data may be transformed to createthe header portion or portions for the different media contentrepresentation. As another example, the header data for a particularmedia content section may be stored in a base state that may then beused to dynamically generate each media content representation that isrequested.

At 322, the media content item representation data is stored for use increating media content item representations. According to variousembodiments, the media content item representation data may be stored ina storage system for retrieval by a content server. For instance, themedia content item representation data may be stored in the storagesystem 106 discussed with respect to FIG. 1. The operations of oneexample of a content server are discussed with respect to the contentserver 108 shown in FIG. 1.

FIG. 4 illustrates a method 400 for delivering media content to a clientmachine, performed in accordance with one or more embodiments. Accordingto various embodiments, the method 400 may be performed at a mediacontent server configured to provide media content upon request. Themedia content server may be associated with a media content systemconfigured to provide any of a variety of media-related services toclient machines. For instance, client devices such as computers, mobilephones, and/or cable boxes may communicate with the media content systemto receive media content or information related to media content forpresenting at the client devices.

According to various embodiments, the method 400 may be performed at aserver in communication with a storage system. For instance, the method400 may be performed at the content server 108 shown in FIG. 1. In FIG.1, the content server 108 is in communication with the storage system106.

At 402, a request is received from a client machine for delivery of amedia content item. According to various embodiments, the request may betransmitted to the server via a network such as the Internet, a cellularnetwork, or a cable network. The request may identify a particular mediacontent item such as a movie, a television show, a song, or any othermedia content item capable of being transmitted by the server thatreceives the request. The media content item requested may betransmitted live or on demand.

At 404, one of a plurality of media content item representations isselected for construction. According to various embodiments, a mediacontent item may be represented in different ways for purposes such assupporting different hardware, software, and/or data transmissioncapabilities for various devices. For example, a personal computer, amobile phone, and a cable box may be configured to play different typesof audio and/or video files.

In particular embodiments, the representation of the media content itemmay be selected based on any of a variety of considerations. Forexample, the request received at operation 402 may be received from adevice known to the server to have a particular set of hardware,software, and/or network transmission capabilities. As another example,the request received at operation 402 may specify a particular type ofset of types of media content item representation to provide in responseto the request.

At 406, common media content data and header information for the mediacontent item is identified. According to various embodiments, the commonmedia content data and header information is data that may be used inconjunction with more than one type of media content itemrepresentation. For example, different media content itemrepresentations may include identical or nearly identical media contentdata. As another example, header information may in at least someinstances be readily transformed between different media content itemrepresentations without performing expensive calculations such asdecryption and encryption. As yet another example, header informationmay be stored in a format that is not specific to any particularrepresentation and may be readily processed to create headers that arespecific to a particular media content item representation.

At 408, a partially encrypted sample of the media content item isselected for sample construction. According to various embodiments, asample such as a video frame may be divided into different portions,some of which are encrypted and some of which are not. The partiallyencrypted sample of the media content item may be created as discussedwith respect to FIG. 3. The partially encrypted samples may be selectedfor construction in chronological order within the media content or inany other order.

At 410, one or more portions of the sample that are not encrypted areidentified. At 412, one or more portions of the sample that areencrypted with representation-specific encryption are identified.According to various embodiments, the unencrypted and encrypted portionsof the sample may be created as discussed with respect to the operations308-316 shown in FIG. 3. These portions may correspond with slices of avideo frame.

At 414, the identified sample portions are combined to create arepresentation-specific sample. As discussed with respect to FIGS. 1 and2, a sample may include interleaved encrypted and unencrypted portions.The encrypted portions may be specific to the representation, while theunencrypted portions may be common to more than one representation.Combining the sample portions identified at operations 410 and 412 maybe performed by interleaving the portions in a way that reflects themanner in which they were created as discussed with respect to FIG. 3and is shown in FIGS. 1 and 2. Instructions for combining the sampleportions may be stored along with the portions themselves that arecreated as discussed with respect to FIG. 3.

At 416, a determination is made as to whether to construct an additionalpartially encrypted sample. According to various embodiments, a mediacontent item may include potentially many different partially encryptedsamples. For example, in some instances each sample within the mediacontent item may be partially encrypted. As another example, in someinstances only particularly important samples such as key frames withinvideo content may be partially encrypted. As yet another example, insome combinations some combination of samples such as samples selectedat random or regular interfaces may be partially encrypted. Accordingly,the determination made at operation 416 may be made at least in part bydetermining which samples associated with the media content item werepartially encrypted as discussed with respect to FIGS. 1-3.

At 418, the constructed partially encrypted samples are combined withthe common media content data to construct the media content itemrepresentation. As discussed with respect to FIGS. 1 and 2, varioustypes of media content item representations may be employed.Accordingly, the specific operations performed at operation 418 maydepend on the particular media content representation being constructed.

According to various embodiments, constructing the media content itemrepresentation may include various types of operations. For example, thevideo data including common data and/or constructed partially encryptedsamples may be divided or segmented in a manner specific to theparticular media content item representation selected at operation 404.As another example, the header information identified in operation 406may be modified or transformed to create headers that are appropriatefor the selected representation. As yet another example, headerinformation, common media content data, and constructed partiallyencrypted samples may be interleaved in a manner appropriate for theselected representation.

At 420, the constructed media content item representation is transmittedto the client machine. According to various embodiments, the constructedmedia content item representation may be transmitted via a network suchas the Internet, a cable television network, or a cellular network. Inparticular embodiments, all or portions of the media content itemrepresentation may be stored in a cache so that some or all of the mediacontent item representation may be transmitted to client machines uponrequest without separately constructing the representation for eachrequest. For instance, a media content item presented in a live mediacontext may be separately requested by potentially many different clientdevices at the same time.

FIG. 7 illustrates an interaction for a client receiving a media streamsuch as a live stream. The client starts playback when fragment 41 playsout from the server. The client uses the fragment number so that it canrequest the appropriate subsequent file fragment. An application such asa player application 507 sends a request to mediakit 505. The requestmay include a base address and bitrate. The mediakit 505 sends an HTTPget request to caching layer 503. According to various embodiments, thelive response is not in cache, and the caching layer 503 forwards theHTTP get request to a fragment server 501. The fragment server 501performs processing and sends the appropriate fragment to the cachinglayer 503 which forwards to the data to mediakit 505.

The fragment may be cached for a short period of time at caching layer503. The mediakit 505 identifies the fragment number and determineswhether resources are sufficient to play the fragment. In some examples,resources such as processing or bandwidth resources are insufficient.The fragment may not have been received quickly enough, or the devicemay be having trouble decoding the fragment with sufficient speed.Consequently, the mediakit 505 may request a next fragment having adifferent data rate. In some instances, the mediakit 505 may request anext fragment having a higher data rate. According to variousembodiments, the fragment server 501 maintains fragments for differentquality of service streams with timing synchronization information toallow for timing accurate playback.

The mediakit 505 requests a next fragment using information from thereceived fragment. According to various embodiments, the next fragmentfor the media stream may be maintained on a different server, may have adifferent bitrate, or may require different authorization. Caching layer503 determines that the next fragment is not in cache and forwards therequest to fragment server 501. The fragment server 501 sends thefragment to caching layer 503 and the fragment is cached for a shortperiod of time. The fragment is then sent to mediakit 505.

FIG. 6 illustrates a particular example of a technique for generating amedia segment. According to various embodiments, a media stream isrequested by a device at 601. The media stream may be a live stream,media clip, media file, etc. The request for the media stream may be anHTTP GET request with a baseurl, bitrate, and file name. At 603, themedia segment is identified. According to various embodiments, the mediasegment may be a 35 second sequence from an hour long live media stream.The media segment may be identified using time indicators such as astart time and end time indicator. Alternatively, certain sequences mayinclude tags such as fight scene, car chase, love scene, monologue,etc., that the user may select in order to identify a media segment. Instill other examples, the media stream may include markers that the usercan select. At 605, a server receives a media segment indicator such asone or more time indicators, tags, or markers. In particularembodiments, the server is a snapshot server, content server, and/orfragment server. According to various embodiments, the server delineatesthe media segment maintained in cache using the segment indicator at607. The media stream may only be available in a channel buffer. At 609,the server generates a media file using the media segment maintained incache. The media file can then be shared by a user of the device at 611.In some examples, the media file itself is shared while in otherexamples, a link to the media file is shared.

FIG. 7 illustrates one example of a server. According to particularembodiments, a system 700 suitable for implementing particularembodiments of the present invention includes a processor 701, a memory703, an interface 711, and a bus 715 (e.g., a PCI bus or otherinterconnection fabric) and operates as a streaming server. When actingunder the control of appropriate software or firmware, the processor 701is responsible for modifying and transmitting live media data to aclient. Various specially configured devices can also be used in placeof a processor 701 or in addition to processor 701. The interface 711 istypically configured to send and receive data packets or data segmentsover a network.

Particular examples of interfaces supported include Ethernet interfaces,frame relay interfaces, cable interfaces, DSL interfaces, token ringinterfaces, and the like. In addition, various very high-speedinterfaces may be provided such as fast Ethernet interfaces, GigabitEthernet interfaces, ATM interfaces, HSSI interfaces, POS interfaces,FDDI interfaces and the like. Generally, these interfaces may includeports appropriate for communication with the appropriate media. In somecases, they may also include an independent processor and, in someinstances, volatile RAM. The independent processors may controlcommunications-intensive tasks such as packet switching, media controland management.

According to various embodiments, the system 700 is a server that alsoincludes a transceiver, streaming buffers, and a program guide database.The server may also be associated with subscription management, loggingand report generation, and monitoring capabilities. In particularembodiments, the server can be associated with functionality forallowing operation with mobile devices such as cellular phones operatingin a particular cellular network and providing subscription managementcapabilities. According to various embodiments, an authentication moduleverifies the identity of devices including mobile devices. A logging andreport generation module tracks mobile device requests and associatedresponses. A monitor system allows an administrator to view usagepatterns and system availability. According to various embodiments, theserver handles requests and responses for media content relatedtransactions while a separate streaming server provides the actual mediastreams.

Although a particular server is described, it should be recognized thata variety of alternative configurations are possible. For example, somemodules such as a report and logging module and a monitor may not beneeded on every server. Alternatively, the modules may be implemented onanother device connected to the server. In another example, the servermay not include an interface to an abstract buy engine and may in factinclude the abstract buy engine itself. A variety of configurations arepossible.

In the foregoing specification, the invention has been described withreference to specific embodiments. However, one of ordinary skill in theart appreciates that various modifications and changes can be madewithout departing from the scope of the invention as set forth in theclaims below. Accordingly, the specification and figures are to beregarded in an illustrative rather than a restrictive sense, and allsuch modifications are intended to be included within the scope ofinvention.

1. A method comprising: storing a media content item at a media server,the media content including a first media content data, a second mediacontent data, the first media content data comprising one or morenon-key frames, the second media content data comprising one or more keyframes, wherein storing the media content item includes storing only asingle copy of the first media content data as unencrypted data, andwherein storing the media content item includes storing multiple copiesof the second media content data as encrypted data, each copy of themultiple copies of the second media content data being a differentdesignated streaming format; receiving at the media server a requestfrom a client device to transmit the media content item via acommunications interface, the media content item comprising video data,the media content item being associated with a plurality of streamingformats; constructing at the media server the requested media contentitem in a designated streaming format by creating a particular mediacontent item representation, via a processor at the media server, theparticular media content item representation created by transforming thestored header that is not specific to any designated streaming formatinto a format for the designated streaming format, and combining thestored one or more non-key frames of the first media content data, thestored one or more key frames of second media content date, and thetransformed header; and transmitting the particular media content itemrepresentation to the client device via the communications interface forplayback.
 2. The method recited in claim 1, wherein the particular mediacontent item representation comprises a video content frame.
 3. Themethod recited in claim 1, wherein the particular media content itemrepresentation is specific to the designated streaming format.
 4. Themethod recited in claim 1, wherein the designated streaming formatincludes a plurality of unencrypted media content portions, each of theunencrypted media content portions being common to the plurality ofstreaming formats.
 5. The method recited in claim 1, wherein thedesignated streaming format includes a plurality of header portions,each of the plurality of header portions being specific to thedesignated streaming format.
 6. The method recited in claim 5, whereineach of the plurality of header portions is created in response toreceiving the request, and wherein each of the plurality of headerportions is created based on header data common to the plurality ofstreaming formats.
 7. The method recited in claim 1, wherein thedesignated streaming format is selected from the plurality of streamingformats based on a hardware or software capability of the client device.8. A system comprising: a processor; and memory, the memory storinginstructions to execute a method, the method comprising: storing a mediacontent item at a media server, the media content including a firstmedia content data, a second media content data, the first media contentdata comprising one or more non-key frames, the second media contentdata comprising one or more key frames, wherein storing the mediacontent item includes storing only a single copy of the first mediacontent data as unencrypted data, and wherein storing the media contentitem includes storing multiple copies of the second media content dataas encrypted data, each copy of the multiple copies of the second mediacontent data being a different designated streaming format; receiving atthe media server a request from a client device to transmit the mediacontent item via a communications interface, the media content itemcomprising video data, the media content item being associated with aplurality of streaming formats; constructing at the media server therequested media content item in a designated streaming format bycreating a particular media content item representation, via a processorat the media server, the particular media content item representationcreated by transforming the stored header that is not specific to anydesignated streaming format into a format for the designated streamingformat, and combining the stored one or more non-key frames of the firstmedia content data, the stored one or more key frames of second mediacontent date, and the transformed header; and transmitting theparticular media content item representation to the client device viathe communications interface for playback.
 9. The system recited inclaim 8, wherein the particular media content item representationcomprises a video content frame.
 10. The system recited in claim 8,wherein the particular media content item representation is specific tothe designated streaming format.
 11. The system recited in claim 8,wherein the designated streaming format includes a plurality ofunencrypted media content portions, each of the unencrypted mediacontent portions being common to the plurality of streaming formats. 12.The system recited in claim 8, wherein the designated streaming formatincludes a plurality of header portions, each of the plurality of headerportions being specific to the designated streaming format.
 13. Thesystem recited in claim 12, wherein each of the plurality of headerportions is created in response to receiving the request, and whereineach of the plurality of header portions is created based on header datacommon to the plurality of streaming formats.
 14. The system recited inclaim 8, wherein the designated streaming format is selected from theplurality of streaming formats based on a hardware or softwarecapability of the client device.
 15. One or more non-transitory computerreadable media having instructions stored thereon for performing amethod, the method comprising: storing a media content item at a mediaserver, the media content including a first media content data, a secondmedia content data, the first media content data comprising one or morenon-key frames, the second media content data comprising one or more keyframes, wherein storing the media content item includes storing only asingle copy of the first media content data as unencrypted data, andwherein storing the media content item includes storing multiple copiesof the second media content data as encrypted data, each copy of themultiple copies of the second media content data being a differentdesignated streaming format; receiving at the media server a requestfrom a client device to transmit the media content item via acommunications interface, the media content item comprising video data,the media content item being associated with a plurality of streamingformats; constructing at the media server the requested media contentitem in a designated streaming format by creating a particular mediacontent item representation, via a processor at the media server, theparticular media content item representation created by transforming thestored header that is not specific to any designated streaming formatinto a format for the designated streaming format, and combining thestored one or more non-key frames of the first media content data, thestored one or more key frames of second media content date, and thetransformed header; and transmitting the particular media content itemrepresentation to the client device via the communications interface forplayback.
 16. The non-transitory computer readable medium recited inclaim 15, wherein the particular media content item representationcomprises a video content frame.
 17. The non-transitory computerreadable medium recited in claim 15, wherein the particular mediacontent item representation is specific to the designated streamingformat.
 18. The non-transitory computer readable medium recited in claim15, wherein the designated streaming format includes a plurality ofunencrypted media content portions, each of the unencrypted mediacontent portions being common to the plurality of streaming formats. 19.The non-transitory computer readable medium recited in claim 15, whereinthe designated streaming format includes a plurality of header portions,each of the plurality of header portions being specific to thedesignated streaming format.
 20. The non-transitory computer readablemedium recited in claim 19, wherein each of the plurality of headerportions is created in response to receiving the request, and whereineach of the plurality of header portions is created based on header datacommon to the plurality of streaming formats.